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Abstract — To promote the global search ability of the original 
state transition algorithm, a new operator called axesion is 
suggested, which aims to search along the axes and strengthen 
single dimensional search. Several benchmark minimization 
problems are used to illustrate the advantages of the improved 
algorithm over other random search methods. The results of 
numerical experiments show that the new transformation can 
enhance the performance of the state transition algorithm and 
the new strategy is effective and reliable. 

I. Introduction 

THE basic random optimization(BRO) was proposed by 
MatyasJT] in 1965, and it is proved that the BRO can 
ensures convergence to a global minimum with probability 
one((2j,|3|). To enhance the performance of the random 
optimization, various strategies have been introduced. In 
ID, to adjust the parameters of mean and standard devia- 
tion in a Gaussian vector, a heuristic random optimization 
(HRO) war presented, utilizing two different mechanisms 
based on gradient information and reinforcement, respec- 
tively. In ([5|,[l6)X two approaches named adaptive random 
search technique(ARSET) and dynamic random search tech- 
nique(DARSET) were put forward by Coskun Hamzacebi 
and Fevzi Kutay, to facilitate the determination of the global 
minimum. Then, another new random search algorithm 
named random selection walk(RSW) was raised through 
integrating the random selection and walk algorithmsJTl. 

Based on the concepts of state and state transition, a 
metaheuristic random search method called state transition 
algorithm(STA) was emerged, and experimental results have 
shown that the proposed algorithm is advantageous for most 
of the test problems[8|. On the other hand, especially for 
optimization functions with independent variables, it is easy 
to get trapped into local optimum. In this study, a new 
operation call axesion transformation is raised to promote its 
search ability. Comparisons with other methods on several 
benchmark problems are presented in the paper, and the 
outcome is satisfactory, which shows that the proposed 
strategy is effective. 

II. THE BASIC FRAMEWORK OF STA 

In general, the form of state transition algorithm can be 
described as the following 



Xk- 
2/M 



■■ A k x k + B k u k 

f{Xk+l) 



(1) 
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where x k stands for a state, corresponding to a solution of 
the optimization problem; A k and B k are state transition 
matrixes, which are usually transformation operators; u k is 
the function with variables Xk and history states; / is the 
objective function or evaluation function. 

Using various types of space transformation for reference, 
three special state transformation operators are defined to 
solve continuous function optimization problems. 

(1) Rotation transformation 

x k+1 = x k + a 1 R r x k (2) 
n.||£fe||2 

where x k G W iXl , a is a positive constant, called rotation 
factor; R r £ 5ft" x ", is random matrix with its elements 
belonging to the range of [-1, 1] and || • H2 is 2-norm of a 
vector. It has proved that the rotation transformation has the 
function of searching in a hypersphere[8|. 

(2) Translation transformation 



x k+ i = x k + (3R t 



%k ^fc— 1 
\\x k - X k -i\\ 2 



(3) 



where j3 is a positive constant, called translation factor; R t 
G 5ft 1 is a random variable with its elements belonging to the 
range of [0, 1 ] . It has illustrated the translation transformation 
has the function of searching along a line from x k -i to x k 
at the starting point x k , with the maximum length of /3®. 
(3) Expansion transformation 



x k+1 = x k + jR e x k 



(4) 



where 7 is a positive constant, called expansion factor; 
R e € 5ft" x "is a random diagonal matrix with its elements 
obeying the Gaussian distribution. It has also stated the 
expansion transformation has the function of expanding the 
elements in x k to the range of [-00, +00], searching in the 
whole space [8 |. 

The procedures of the original state transition algorithm 
can be outlined in the following pseudocode. 

l: Initialize feasible solution x(Q) randomly, set a, (3, 7, and 

k <- 

2: repeat 
3: k <- k + 1 
4: while a < tolerance do 
5: State 4— opjrotate(x(k — 1), SE, a) 

6: if min f (State) < f(x(k - 1)) then 

7: Updating x(k — 1) 

8: State 4— opJ:ranslate(x(k — 1), SE, (3) 

9: if min f (State) < f(x(k ~ 1)) then 



10: 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20: 
21 
22 
23 
24 



Updating x(k — 1) 
end if 
end if 

end while 

State <!— op_expand(x(k — 1), SE, 7) 
if min f (State) < f(x(k - 1)) then 
Updating x(k — 1) 

State <— op-translate(x(k — 1), SE, 0) 
if min f (State) < f(x(k - 1)) then 

Updating x(k — 1) 
end if 
end if 

x(k) <— x(k - 1) 
until the specified termination criterion is met 



where (SE) is search enforcement, which means 
the times of the transformation. Operators such as 
opjrotate(-), op_translate(-) and op_expand(-) correspond 
to the rotation, translation, and expansion, respectively, fc 
is a constant coefficient used for lessening the a. By the 
way, the translation operator will only be performed when 
a better solution is obtained. 



the meanwhile, to reduce the computational complexity, the 
rotation transformation will be executed in an outer loop 
instead of an inner loop, that is to say, the a factor will 
vary in a periodic way. 




Fig. 1 

THE FUNCTION OF AXESION TRANSFORMATION 



III. A NEW TRANSFORMATION INTO THE STA 

In the proposed STA, three different state transformation 
operators are designed, aiming for exploration(global search) 
and exploitation(local search) as well as the equilibrium 
between them. It is beneficial for optimization functions with 
relevant variables; however, for functions with independent 
variables, it is necessary to intensify the single dimension 
search. 

To simplify the one dimensional search, a new operator 
called axesion is added to the STA, which, in its meaning, 
aims to search along each axes. 
(4) Axesion transformation 

X k+1 = X k + SRaXk (5) 

where 5 is a positive constant, called axesion factor; R a 
€ 5ft nx ™ is a random diagonal matrix with its elements 
obeying the Gaussian distribution and only one random 
index has value. For example, R a 6 5ft 3 x 3 can be the 
following styles: 



IV. Numerical experiments 

Experiments are divided into two groups. The first group 
consist of five benchmark problems which have been tested 
by HRO, ARSET, and RSW, while the second group bench- 
mark problems have been tested by DARSET and RSW. In 
the proposed original STA and new STA, all of the problems 
will be carried out. Parameters of the STAs are described in 
Table UJ and the lessening coefficient fc will be 4 in original 
STA and 2 in new STA. 

TABLE I 
Parameters of the STAs 



Parameter Value 

epoch number 1000 

S-E^Search enforcement) 32 

a 1 -> le-4 

1 

7 1 

8 1 
fc 4(2) 



0.1 






0.2 






0.3 



To illustrate the functions of the axesion transformation, let 
suppose the Xk = [1; 1; 1] and 5 = 1; then, after le3 times of 
independent axesion transformation, the distribution of x k +i 
can be illustrated on the space as described in FigureQ] 

When the new transformation is introduced into the orig- 
inal STA, it will follow the same procedures as rotation 
and expansion, while translation transformation will only be 
performed when a better solution is gained by axesion. In 



A. The first Group 

(1) Problem f x 

The first problem is taken from [4,5,7], objective function 
of the problem is given as follows 

x 2 , if x<l, 

(x-3) 2 -3, if x>\. K} 

As can be seen from Fig. [2] the function has two mini- 
mums, one lying on x — and the other one on x = 3. Their 
results of the HRO, ARSET, RSW, and STAs are given in 
Table HI] Both STAs can achieve the global minimum in the 



h = 



end, as a matter of fact, STAs can meet the optimum in no 
more than 10 epoches. 
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THE LANDSCAPE OF / 2 



Fig. 2 
THE LANDSCAPE OF /l 



TABLE II 
Results for the /i 



Algorithms 


Best x 


Best f(x) 


HRO 


3.000324 


-3 


ARSET 


3 


-3 


RSW 


3 


-3 


STA(original) 


3 


-3 


STA(new) 


3 


-3 



(2) Problem f 2 

The second problem is taken from [4,5,7], objective func- 
tion of the problem is given as follows 

f 2 = [xsin{-)] A + [xcos{-)]\ /(0) = lim f(x) = (7) 

X X x-¥0 

As can be seen from Fig. [3] the function has numerous 
local minimums. Their results of the HRO, ARSET, RSW, 
and STAs are given in Table [Til] Both STAs can achieve the 
global minimum in the end, as a matter of fact, STAs can 
meet the optimum in no more than 50 epoches. 

TABLE III 
Results for the / 2 



Algorithms 


Best x 


Best f(x) 


HRO 


2.4000e-005 


2.8595e-019 


ARSET 


-2.53e-011 


2.21e-043 


RSW 


8.17e-82 





STA(original) 


2.0447e-082 





STA(new) 


3.5197e-084 






(3) Problem f 3 

The third problem is taken from [5,7], objective function 
of the problem is given as follows 

(x - 3) 8 (y - 3) 4 



h = 



l + (x- 3) 8 1 + (y - 3) 4 



(8) 



As can be seen from Fig.|4j the function also has numerous 
local minimums. Their results of the ARSET, RSW, and 
STAs are given in Table [IV] Compared with ARSET and 
RSW, STAs can get better solution than them, in the same 
time, STAs can meet the specified precision in no more than 
100 epoches. 




-10 -10 
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THE LANDSCAPE OF fs 



(4) Problem / 4 

The fourth problem is taken from [5,7], objective function 
of the problem is given as follows 



U = 100(z - y 2 ) 2 + {l-x) 



(9) 



Fig. [5] shows the graph of the function, which is widely 
used for testing because there is a valley in the landscape, 
making it hard to optimize. Their results of the ARSET, 
RSW, and STAs are given in Table [V] Compared with 
ARSET and RSW, STAs seem a little deficient for the 
function. 



TABLE IV 
Results for the f 3 



Algorithms 


Best x 


Best y 


Best f(x,y) 


ARSET 


3.0015 


3 


5.04e-023 


RSW 


2.9996 


3 


3.43e-28 


STA(original) 


3.0000 


3.0000 


5.8715e-033 


STA(new) 


3.0000 


3.0000 


1.0335e-035 



xio' 






Fig. 5 

THE LANDSCAPE OF / 4 
TABLE V 



Results for the /4 



Algorithms 


Best x 


Best y 


Best f(x,y) 


ARSET 


1 


1 


4.02e-016 


RSW 


1 


1 


1.97e-31 


STA(original) 


1.0000 


1.0000 


8.2040e-012 


STA(new) 


1.0000 


1.0000 


3.7678e-012 



(5) Problem / 5 

The fifth problem is taken from [5,7],objective function of 
the problem is given as follows 

h = ~T~T~\ r (10) 

Fig. [6] shows the graph of the function, which is indiffer- 
entiable at the minimum point. Their results of the ARSET, 
RSW, and STAs are given in Table [Vl] Compared with 
ARSET and RSW, STAs are much better than them, because 
only they can meet the global minimum. 

TABLE VI 



Results for the /s 



Algorithms 


Best x 


Best y 


Best f(x, y) 


ARSET 


-10 


6.67e-008 


-10 


RSW 


-9.9996 


-6.57e-17 


-9.9996 


STA(original) 


-10.0000 


0.0000 


-10 


STA(new) 


-10.0000 


0.0000 


-10 
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B. The second Group 

Problems g\ to 1715 are taken from [6] and [7], which have 
been tested by DARSET and RSW. The detailed information 
of the test functions are listed in Table [Vll] In DARSET 
and RSW, epoch number varies from 250200 to 2508000; 
however, in original STA and new STA, both the epoch 
number is fixed at 1000, and 10 independent times are run. 

As described in Table [VTIll the original STA can get the 
same results as DARSET and RSW in 34,35,56,57,38,514 
and 315. For 31 and 310, the results of original STA are 
better than DARSET but a little inferior to BSW, for g 2 and 
33, the original STA can get better results than BSW but a 
little inferior to DARSET, and for gn, the original STA can 
gain better solution than both DARSET and BSW. 

On the other hand, the new STA can achieve the best 
results of all functions except for 39,312 and 313. Even so, 
it is obvious to find that the new STA actually can achieve 
the global minimums in a specified precision. 

Through the numerical experiments, it has proved that the 
new STA has better performance than the original STA in 
terms of the global search ability and the proposed axesion 
transformation is beneficial for STA. 

The reasons of the efficiency of the new strategy can be 
explained as: (1) axesion transformation enlarge the search 
space. Not only rotation but also expansion, both of them 
search in the neighborhood of the best solution, of which, 
one search in a unit hypersphere, the other search in a 
relative broader space but with low probability, while the 
new operator can also search in global space, that is to say, 
the probability of finding the global optimum is increased. (2) 
the new transformation has the function of single dimensional 
search, which is advantageous for functions with independent 
variables. (3) the new transformation can achieve good 
quality solution with high precision. When searching in a 
single direction, the axesion can enhance the depth of search. 



TABLE VII 

The second group functions for test in this paper 



Function 



gi=x" + 2y z 



Dimension Variable range Theoretical best 



0.3cos(3tyx) - QAcos^ixy) + 0.7 
52 = [cos(2nx) + cos(2.5ivx) — 2.1] [2.1 — cos(3-iry) + cos(3.5ivy)] 



93 = [0.002 + + Er=iC* - ^) 6 )" 1 ]" 1 

-32 -16 16 32 ... -32 -16 
-32 -32 -32 -32 -32 ... 32 32 



a 



16 

32 



32 
32 



9* 

95 



(V 

(4- 



5.1 
4tt 2 



x 2 + f x - 6) 2 + 10(1 - ±)cos(x) + 10 
2.1a; 2 + ^)a 2 + xy+ (4y 2 - 4)y 2 



56 = [1 + (x + y + 1) 2 (19 - 14a; + 3a; 2 - Uy + 6xy + 3y 2 )} 
x[30 + (2a; - 3y) 2 (18 - 32a; + 12a 2 + 48y - 36a;y + 27y 2 )] 
97 = Ei=i icos ((« + 1)* + i)\ x E-=i icos ((* + l )v + *)] 

ff8 = Et 1 (^(« l ) ! '(^) Z -C l ) 2 

a = |5 3 0.6 0.1 3|, 6 = |10 1 0.6 2 1.8], c = |2.122 9.429 23.57 74.25 6.286] 
59 = 100(a 2 - x 2 ) 2 + (1 - a-0 2 + 90(a 4 - x%) 2 + (1 - a 3 ) 2 
+ 10.1[(a 2 - l) 2 + (x 4 - l) 2 ] + 19.8(a 2 - l)(a 4 - 1) 

9io = ESi[(«?) ( " ?+1+1) + (^ + i) ( " ?+1) ] 

5 11 = (^)[10sm 2 (7rai) + Ei=i((«» - !) 2 (! + 10sm 2 (7ra,+i)) + (x 20 - l) 2 ] 

512 = 100(2/ - a 2 ) 2 + (1 - a) 2 

513 = eap(0.5(a; 2 + y 2 - 25) 2 ) + sin 4 (4a; - 3y) + 0.5(2a + y- 10) 2 

514 = 0.1[12 + a 2 + 



l+MZ 



(xy 



5i5 = (xi + 10x 2 ) + 5(x 3 - xa) +(a 2 -2a 3 ) + 10(ai - a 4 ) 



r 



[-1.28,1.28] 
[-1,1] 
[-65.536,65.536] 





-16.0917 
0.9980 



L 

2 


a- G [-5, 10] 
V G [0, 15] 
x e [-3, 3] 
2/ G [-2, 2] 


0.39 ly 

-1.0316 


2 


[-5,5] 


3 


2 


[-10,10] 


-186.730 


3 


[-co, oo] 


8.0128 


4 


[-10,10] 





20 


[-1,4] 





20 


[-10,10] 





2 


[-10,10] 





2 


[-5,5] 


1 


2 


[0,10] 


1.74 


4 


[-5,5] 






TABLE VIII 

Test results of the second group functions in this paper 



Function DRASET RSW STA(original) STA(new) 





Best 


Average 


Best 


Average 


Best 


Average 


Best 


Average 


9i 





9.10e-016 











5.3147e-012 








92 


-16.0917 


-16.0917 


-16.0917 


-15.7399 


-16.0917 


-16.0917 


-16.0917 


-16.0917 


93 


0.998 


1.5885 


0.998 


6.3728 


0.9980 


3.9354 


0.9980 


0.9980 


9* 


0.3979 


0.3979 


0.3979 


0.3979 


0.3979 


0.3979 


0.3979 


0.3979 


95 


-1.0316 


-1.0316 


-1.0316 


-1.0316 


-1.0316 


-1.0316 


-1.0316 


-1.0316 


96 


3 


3 


3 


3 


3.0000 


3.0000 


3.0000 


3.0000 


97 


-186.7309 


-186.7309 


-186.7309 


-186.7309 


-186.7309 


-186.7309 


-186.7309 


-186.7309 


98 


8.0128 


8.0128 


8.0128 


8.0128 


8.0128 


8.0128 


8.0128 


8.0128 


99 


3.72e-12 


9.30e-06 


1.28e-28 


2.15e-28 


2.8718e-010 


1.1802e-009 


8.3086e-011 


1.1344e-009 


9io 


2.45e-16 


4.02e-15 














4.9783e-094 


2.7247e-084 


9ii 


5.93e-12 


26.227 


2.36e-32 


3.3927 


7.2021e-011 


1.0417 


2.6223e-011 


3.8022e-011 


912 


3.91e-15 


4.28e-14 


2.84e-29 


6.07e-28 


8.9683e-014 


3.8771e-012 


9.5239e-014 


9.9002e-012 


913 


1 


1.0077 


1.0091 


1.0091 


1.0000 


1.0375 


1.0000 


1.0225 


9ii 


1.7442 


1.7442 


1.7442 


1.7442 


1.7442 


1.7442 


1.7442 


1.7442 


915 


8.17e-09 


1.68e-07 


1.02e-ll 


1.71e-ll 


2.1942e-014 


6.4995e-009 


9.9870e-014 


1.0542e-007 



V. Conclusions 

As a random search method, the original STA has shown 
the great ability in optimizing continuous functions. To 
enhance the global search capability of the STA, axesion 
transformation is introduced into the original STA, which 
aims to search along a single dimension in depth. The results 
of the numerical experiments have testified the efficiency and 
reliability of the new STA. Comparisons with other random 
optimization methods, the outcome of the experiments has 
also revealed the advantages of the STAs. By the way, other 
functions with independent variables have also been tested, 
and results are more satisfactory. 
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